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(54) A system using residual images to represent a color digital image 



(57) A digital image processing system includes 
one or more opto-electronic image digitization device(s) 
which digitize still photographic images and produce an 
extended color gamut digital image corresponding to 
each still photographic image, and an image processing 
unit, coupled with said image digitization device{s), 
which is operative to receive a plurality of extended 
color gamut digital images from the image digitization 
device(s). The image processing unit produces at least 
one limited color gamut digital image from each said 
extended color gamut digital image by adjusting the 
color values of the extended color gamut digital image 
to fit within a limited color gamut; represents each said 
limited color gamut digital image in a storage color 
space; determines one or more residual image(s) each 
representing a difference between one said extended 
color gamut digital image and its corresponding limited 
color gamut digital image; and associates each limited 
color gamut digital image in the storage color space with 
its residual image(s) such that the associated residual 
images and the limited color gamut digital images in the 
storage color space are adapted to be used to recon- 
struct extended color gamut digital images. 
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Description 

[Q001] The present invention relates to the field of dig- 
ital imaging, and more particularly to a digital imaging 
system employing an extended color gamut digital 5 
image. 

[0002] A digital imaging system is comprised of one or 
more digitization units, one or more image processing 
units, and one or more image display units. The system 
components may be co-located at a single site, or dis- w 
persed over separate geographic locations. In addition 
to the geographic diversity, system components may 
perform related image processing operations at various 
non-contiguous points in time. Thus the transmission of 
digital image information from one location to another, ts 
and from one point in time to another, is central to the 
operation of a digital imaging system. 
[0003] In digital imaging systems, there are many 
ways to represent images in digital form. Not only are 
there many different formats of digital files, used to 20 
encapsulate the image information, but there is also a * 
large variety of different color spaces and color encod- 
ings that can be used to specify the color of digital 
images within the digital files. The fundamental objec- 
tive of these image representations is to communicate 25 
the necessary image information from the "earlier 
image processing operations to the "later" image 
processing operations. 

[0004] In some cases, the color encoding may be in 
terms of a so-called device independent color space, 30 
such as the well-known CIELAB color space. In recent 
years this color space has been used extensively to 
specify the color of digital images in color-managed dig- 
ital imaging systems. In some cases, the image may 
actually be stored in the CIELAB color space. More 35 
commonly, the color space may be used to connect 
device profiles, which can be used to describe the color 
characteristics of various color imaging devices such as 
scanners, printers, and CRT video displays. The 
KODAK PhotoYCC Color Interchange Space is another 40 
example of a device independent color space that can 
be used to encode digital images. 
[0005] In other cases, the color encoding may be in 
terms of a device dependent color space. For example, 
an image processing operation performed in conjunc- 45 
tion with an image digitization operation, may presup- 
pose the intended image display and encode the image 
in a display-ready representation. Video RGB color 
spaces and CMYK color spaces are examples of this 
type of encoding. When a color image is encoded in a so 
display device dependent color space, it will have the 
e desired color appearance when it is displayed on the 
particular display device associated with that color 
space. The advantage of a device dependent color 
space is that the image is ready to be displayed or 55 
printed on the target device. However, the disadvantage 
is that the image will necessarily be limited to the color 
gamut of the particular target device. The color gamut of 



an imaging device refers to the range of colors and lumi- 
nance values that can be produced by the device. 
Therefore, if the target device has a limited dynamic 
range, or is incapable of reproducing certain saturated 
colors, then it is not possible to encode color values out- 
side of the range of colors that can be produced on the 
device. This limitation will constrain each of the later 
image processing and display operations. 
[0006] One type of device dependent color space that 
has become quite widespread for use as a storage and 
manipulation color space for digital images is the video 
RGB color space. In reality, there are many different 
video RGB color spaces due to the fact that there are 
many different types of video RGB displays. As a result, 
a particular set of video RGB color values will corre- 
spond to one color on one video display and to another 
color on another video display. Therefore, video RGB 
has historically been a somewhat ambiguous color rep- 
resentation due to the fact that the color values could 
not be properly interpreted unless the characteristics of 
the target video display were known. Nonetheless, 
video RGB color spaces have become the defacto 
standard in many applications because the creation, 
display and editing of images on video displays are cen- 
tral steps in many digital imaging systems. 
[0007] Recently, there have been efforts to standard- 
ize a particular video RGB color space in order to 
remove the ambiguity in the interpretation of the color 
values. (See the proposed IEC TC100 sRGB Draft 
Standard). One such proposed standard color space is 
known as "sRGB." This color space specifies a particu- 
lar set of red, green, and blue primaries, a particular 
whitepoint, and a particular non-linear code value to 
light intensity relationship. Together, these tightly define 
the overall relationship between the digital code values 
and the corresponding device independent color values. 
[0008] Although the use of a standard video RGB 
color space eliminates much of the ambiguity usually 
associated with video RGB color spaces, it does noth- 
ing to address the fact that encoding with this color 
space constrains the digital imaging system since video 
RGB has a limited color gamut relative to desirable later 
image processing operations and relative to other dis- 
play devices. This constraint arises because any display 
device will have a limited color gamut relative to that of 
an original scene. For example, a scene may have a 
luminance dynamic range of 1000:1 or more, whereas a 
typical video display or reflection print will have a 
dynamic range on the order of 100:1. Certain image 
capture media, such as photographic negative film, can 
actually record dynamic ranges as large as 8000:1. 
Even though this is larger than the luminance dynamic 
range associated with most scenes, the extra dynamic 
range is often useful to provide additional information to 
certain image processing operations as an allowance 
for exposure errors, light source variations, and so forth. 
[0009] In order to encode images from various 
sources in a video RGB representation, it is necessary 
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to discard information that is outside the color gamut of 
the video RGB color space. In some cases, such as 
when it is desired to encode the appearance of colors in 
an original scene or the colors captured by a photo- 
graphic negative, a great deal of information will typi- 
cally need to be discarded due to the large disparity in 
the dynamic ranges. For the case where it is desired to 
scan a reflection print and store it in a video RGB color 
space, it is still necessary to discard a substantial 
amount of information due to the mismatch in the color 
gamuts, even though the luminance dynamic ranges 
may be quite similar. 

[0010] For example, FIG. 1 shows a comparison of a 
typical Video RGB Color Gamut 10 and a typical Reflec- 
tion Print Color Gamut 12. In this case, a*-b* cross-sec- 
tions of the color gamuts are shown in the CIELAB 
space at an L* value of 65. The colors that are inside the 
boundary are within the gamuts of the respective 
devices, while those that are outside the boundary can- 
not be reproduced, and are therefore referred to as "out- 
of-gamut" colors. It can be seen that there is a large set 
of color values with a b* value larger than 60 that can be 
produced on the printer, but are outside the color gamut 
of the video display. As a result, if the reflection print 
were scanned and stored in a video RGB color space, it 
would not be possible to encode this color information. 
[0011] The mismatch between the video RGB color 
gamut and the color gamuts of other display devices 
and image sources represents a serious limitation on 
the usefulness of the video RGB color space in commu- 
nicating digital image information throughout a digital 
imaging system. However, in many cases, the conven- 
ience of storing and transmitting the image in a color 
space that is ready for direct display on a computer 
video CRT has been the over- riding factor in the deter- 
mination of the preferred color space. This has come at 
the expense of image processing and display opera- 
tions that can utilize the extended color gamut informa- 
tion that may have existed in an input image. 
[0012] It is an object of the present invention to over- 
come the limitations of the prior art by providing an 
imaging system for the creation, storage, and use of 
images in a color space having a limited color gamut, 
while retaining the extended color gamut information for 
use by applications and display devices that can make 
beneficial use of this information. 
[0013] This object is achieved in a digital image 
processing system comprising: 

a) one or more opto-electronic image digitization 
device(s) which digitize still photographic images 
and produce an extended color gamut digital image 
corresponding to each still photographic image; 
and 

b) an image processing unit, coupled with said 
image digitization device(s), which is operative to 
receive a plurality of extended color gamut digital 
images from said image digitization device(s) and 



including means for: 

i) producing at least one limited color gamut 
digital image from each said extended color 

5 gamut digital image by adjusting the color val- 

ues of the extended color gamut digital image 
to fit within a limited color gamut; 

ii) representing each said limited color gamut 
digital image in a storage color space; 

w iii) determining one or more residual image(s) 

each representing a difference between one 
said extended color gamut digital image and its 
corresponding limited color gamut digital 
image; and 

15 iv) associating each limited color gamut digital 

image in the storage color space with its resid- 
ual image(s) such that the associated residual 
images and the limited color gamut digital 
images in the storage color space are adapted 

20 to be used to reconstruct extended color gamut 

digital images. 

[0014] The present invention has the advantage that 
digital imaging systems comprised of an image digitiza- 

25 tion unit, in conjunction with an image processing unit, 
can store digital images in a color space convenient for 
a particular application while overcoming the color 
gamut limitation associated with that color space. For 
example, the image can be stored in a video RGB color 

30 space that is well adapted for fast and convenient dis- 
play on a computer system without compromising the 
potential quality of the image for other uses. 
[0015] It has the additional advantage that the use of 
the extended color gamut information is optional for 

35 later image processing and display operations. As a 
result, the benefits of the extended color gamut informa- 
tion can be gained by digital imaging system compo- 
nents and applications that are able to make use of it, 
without introducing an image quality or computation 

40 penalty for components or applications that do not 
require the optional information or that are not able to 
make use of it. 

FIG. 1 is graph comparing the color gamuts of a 
45 typical video display, and a typical reflection print; 

FIG. 2 is an imaging system diagram showing one 
possible configuration of system components 
involved in the process of making limited color 
gamut digital images associated with residual 
so images in accordance with the present invention; 

FIG. 3 is a diagram showing a second imaging sys- 
tem including components enabling a person to 
interact with the process for making limited gamut 
digital images associated with residual images in 
55 accordance with the present invention; 

FIG. 4 is an imaging system diagram showing one 
possible configuration of system components 
involved in the use of the digital image files created 
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in accordance with the present invention; and 
FIG. 5 is a diagram showing a second configuration 
of system components involved in the use of the 
digital image files created in accordance with the 
present invention. 

[0016] Before describing in detail the present inven- 
tion, it should be observed that the present invention 
resides primarily in a digital image color gamut repre- 
sentation and its use, and is not limited to any particular 
imaging system component configuration. Accordingly 
the system components shown in the illustrative block 
diagrams are representative of convenient functional 
categories of system components that may be involved 
in the creation and use of the limited color gamut digital 
images and their associated residual images. 
[0017] One preferred embodiment of the present 
invention is shown in FIG. 2. One or more opto-elec- 
tronic image digitization device(s) 20 digitize still photo- 
graphic images and produce extended color gamut 
digital images 21. Each extended color gamut digital 
image 21 corresponds to one digitized image source. 
An image processing unit 22 receives the extended 
color gamut digital images 21 from the opto-electronic 
image digitization device(s) 20. Each extended color 
gamut digital image 21 has color values that are outside 
the limited color gamut of a storage color space. A pro- 
duce images task 28 performed by the image process- 
ing unit 22 in this embodiment produces (1-n) limited 
color gamut digital images 26 and determines (1-n) 
associated residual images 27. The image processing 
unit 22 operates on each extended color gamut digital 
image 21 as it is available to produce at least one corre- 
sponding limited color gamut digital image 26 by adjust- 
ing the color values of the extended color gamut digital 
images 21 to fit within a limited color gamut. Next, as 
each limited color gamut digital image 26 is available 
the image processing unit 22 represents each limited 
color gamut image 26 in a storage color space. Then 
the image processing unit 22 determines one or more 
residual image(s) 27, associated with each limited color 
gamut digital image 26, and representing the difference 
between each limited color gamut digital image 26 and 
its corresponding extended color gamut digital image 
21 . The limited color gamut digital images 26 in the stor- 
age color space and their associated residual images 
27 are associated such that they are adapted to be used 
to reconstruct extended color gamut digital images 21. 
Further, the image processing unit 22 then operates on 
each limited color gamut digital image 26 with its asso- 
ciated residual image(s) 27 to create corresponding dig- 
ital image files 23, stored internally using a digital 
storage medium. Each digital image file 23 is then deliv- 
ered to the digital file output unit 24 which stores each 
digital image file 23 on a transportable digital storage 
medium 25. 

[001 8] A key aspect of the present invention is the cre- 
ation of residual images 27 representing the differences 



between extended color gamut digital images 21 and 
their corresponding limited color gamut digital images 
26. Other prior art systems include the computation of 
residual images, but none involve computing a differ- 

5 ence between an extended color gamut digital image 
and a limited color gamut digital image. US-A-5,025,325 
describes the computation of a residual image deter- 
mined from the difference between an original image, 
and an image that has been compressed using a lossy 

w image data compression technique and subsequently 
decompressed. The residual image represents the 
compression artifacts that are introduced during the 
compression/decompression process. US-A-5, 122,873 
also describes a method for encoding images using a 

f5 residual image. In this case, the residual image relates 
to the difference between images of different spatial res- 
olution. 

[0019] Each of the aspects of the invention shown in 
FIG. 2 will now be discussed in more detail. The 

20 extended color gamut digital images 21 produced by 
opto-electronic image digitization device (s) 20 can take 
many different forms. For example, one opto-eiectronic 
image digitization device 20 can produce extended 
color gamut digital images 21 from scans of photo- 

25 graphic negatives, another from scans of photographic 
transparencies, or another from scans of photographic 
prints. Further, the opto-electronic digitization device 20 
can be a digital camera, producing extended color 
gamut digital images from original scenes. Depending 

30 on the source of the images, as well as any image 
processing that has been applied to the images, the 
images can have very different color gamuts and color 
representations. Extended color gamut digital images 
21 from scanned photographic negatives and digital 

35 cameras can contain information representative of the 
colors of original scenes having a much larger lumi- 
nance dynamic range than can be encoded in many 
storage color spaces. In this case, luminance dynamic 
range is simply one aspect of color gamut related to the 

40 range of luminance values that can be represented. On 
the other hand, extended color gamut digital images 21 
from photographic negatives, photographic transparen- 
cies, or from photographic prints may represent the 
colors of each of the image source photographic media. 

45 In some cases it can be preferable to represent the 
extended color gamut digital images 21 from a variety of 
image sources as adjusted color values suitable for an 
extended color gamut display device, such as a hypo- 
thetical display device having an idealized color gamut. 

so This approach can provide a common representation 
from a variety of image sources, within certain systems. 
[0020] The color gamut of an imaging system is the 
range of colors that the system can represent or pro- 
duce. The color gamut available at any point within a 

55 particular imaging system is often the result of com- 
bined effects from an imaging medium and an op to- 
electrical imaging component. Since color is fundamen- 
tally a three-dimensional phenomenon, color gamuts 
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can be viewed as a three-dimensional volume. Color 
values that are within the volume are said to be "in- 
gamut," whereas colors that are outside the volume are 
said to be "out-of-gamut." One aspect of the color 
gamut is the luminance dynamic range of the system. 5 
This is the range of relative luminance values that can 
be encoded by the system from the whitest white to the 
blackest black. Another aspect of the color gamut is the 
range of chroma values that can be represented from a 
neutral out to a saturated color. The range of chroma w 
values that are in-gamut will generally be a function of 
hue and lightness. Generally, the highest chroma colors 
can be produced near the hue and lightness of the pri- 
mary and secondary colors of a given imaging device or 
color space (usually red, green, blue, cyan, magenta 15 
and yellow). 

[0021] The image source processed through each 
opto-electronic image digitization device 20 determines 
the initial extent of the color gamut of each image. The 
color gamut of an image digitization operation is deter- 20 
mined both by the digitization component and by any 
image source media. If the images were scanned pho- 
tographic prints, the initial color gamut of the images 
would generally be the color gamut of the original pho- 
tographic print medium. Likewise if the images were 25 
captured by a digital camera, the initial color gamut of 
the images would generally be that of original scenes, 
although it may be limited by the dynamic range of the 
camera sensor and by lens flare. The color space that 
the images are later represented in is somewhat inde- 30 
pendent of the color gamut of the initial digitized 
images. For example, the color values for a scanned 
photographic print can be represented as raw scanner 
code values, or they can be given by device independ- 
ent color values according to a color space such as the 35 
CIELAB color space. Alternatively, the color values can 
be expressed in some other color space, 
[0022] For many systems, it is convenient to store, dis- 
play and manipulate the digital images in a particular 
storage color space that is well-suited for the work flow 40 
associated with that system. Frequently, the storage 
color space that is chosen will be a device dependent 
color space associated with a standard display device 
or medium used by the system. In many cases, video 
RGB color spaces are used because they can be dis- 45 
played or previewed directly on a computer video dis- 
play without any further processing. Additionally, many 
software applications that are available to manipulate 
images on a computer are designed to work with 
images in a video RGB color space. In other cases, par- so 
ticular limited gamut storage spaces may be chosen 
based on other system constraints. The color gamut of 
the storage color space will often be smaller than, or at 
least different than, the initial color gamut of the 
extended color gamut digital images 21. As a result, 55 
there generally will be colors in the extended color 
gamut digital images 21 that can not be represented in 
the storage color space. For example, consider the case 



where the extended color gamut digital images 21 are 
scanned photographic prints. There are many colors 
within the color gamut of a reflection print that are out- 
side the color gamut of the video RGB color space. This 
can clearly be seen in FIG. 1 which shows cross-sec- 
tions through a typical Video RGB Color Gamut 10, and 
a typical Reflection Print Color Gamut 12. 
[0023] Therefore, information must be discarded in 
order to store the reflection print color values in a video 
RGB color space, or in any other limited color gamut 
storage space. It is characteristic of limited color gamuts 
that the particular limitations required for one, such as a 
video RGB display gamut, do not match the required 
limitations for other limited color gamuts. In prior art 
arrangements, the image information that is discarded 
in mapping an image to one limited color gamut is lost 
permanently and can not be recovered. In the present 
invention, the information that is discarded will be stored 
in one or more residual image(s). 
[0024] The image processing unit 22 operates on 
each extended color gamut digital image 21 to adjust 
the color values of the extended color gamut digital 
image 21 to fit within the limited color gamut of the stor- 
age space, forming each limited color gamut digital 
image 26. In this operation, information must be dis- 
carded when color values that are outside the limited 
color gamut are mapped to color values within the lim- 
ited color gamut. In some cases, the color values for the 
out-of-gamut colors are simply "clipped," that is, they 
are mapped to color values the surface of the limited 
color gamut. In other cases, more sophisticated gamut 
mapping methods can be used to compress the 
extended color gamut into the limited color gamut with- 
out introducing a hard clipping function. For example, 
the chroma of the input color values can be scaled so 
that the most saturated colors in the extended color 
gamut are mapped to the most saturated colors in the 
limited color gamut. Alternatively, a gamut mapping 
method can be used that is designed to preserve color 
appearance as closely as possible. Regardless of what 
gamut mapping technique is used, there will necessarily 
be a loss of information and a distortion of the color 
characteristics of the images. 

[0025] In many cases, the extended color gamut will 
contain color values that have higher chroma values 
than can be represented in the limited color gamut. In 
some cases, the extended color gamut can also have a 
larger luminance dynamic range than can be repre- 
sented in the limited color gamut. In the case where it is 
necessary to reduce the luminance dynamic range of 
the images, one part in adjusting the color values of the 
extended color gamut digital images 21 is typically the 
application of a tone scale function. The tone scale 
function might be applied to a luminance channel of the 
images, or alternatively to each color channel of RGB 
color representations. In some applications, the images 
being processed can actually be a monochrome 
images, for example, a black-and-white images. In this 
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case, the tonescale function would be applied to the 
image luminance values. 

[0026] For cases where the extended color gamut dig- 
ital images 21 are representations of the colors in origi- 
nal scenes, adjusting the color values can involve 
determining reproduced color values that will produce 
desired aim colors on a target display device. For exam- 
ple, optimal color reproduction aims can be applied to 
determine desired video RGB aim colors for the original 
scene colors. Alternatively, optimal color reproduction 
aims determined for a standard display device can be 
used in adjusting the color values of the extended color 
gamut digital images 21, producing limited color gamut 
digital images 26 suitable for display on a set of similar 
display devices. The process of transforming the origi- 
nal scene color values into aim reproduced color values 
is sometimes referred to as "rendering" the image. 
[0027] Once the limited color gamut digital images 26 
are determined, the image processing unit then repre- 
sents each limited color gamut digital image 26 in the 
storage color space. This operation typically involves 
applying a device model, or a color space conversion, to 
determine the storage space color values that corre- 
spond to the adjusted color values of the limited color 
gamut digital images 26. For example, if the adjusted 
color values are specified in terms of the CIELAB color 
space, a video display device model can be used to 
determine the corresponding video RGB values that 
would be necessary to produce the specified adjusted 
color values. 

[0028] Next, the image processing unit 22 determines 
one or more residual image(s) 27, associated with each 
limited color gamut digital image 26. The residua! 
image{s) 27 represent the difference between each 
extended color gamut digital image 21 and its corre- 
sponding limited color gamut digital image 26. In its sim- 
plest form, each residual image 27 can be calculated by 
simply subtracting the adjusted color values of each lim- 
ited color gamut digital image 26 from the input color 
values of its corresponding extended color gamut digital 
image 21. The residual image(s) 27 would then be in 
terms of the color space used to represent those color 
values. Alternatively, the limited color gamut digital 
images 26 and extended color gamut digital images 21 
can be transformed into some other space that would 
be useful for computing the residual images 27. For 
example, it might be desirable to compute the residual 
images 27 in a color space that is well-suited for com- 
pressing the residual images 27 or that is convenient for 
use in reconstructing the extended color gamut digital 
images 21. Generally, the extended color gamut digital 
images 21 and the limited color gamut digital images 26 
should be represented in the same color space before 
the residual images 27 are calculated so that the in- 
gamut colors will be given by zero residual errors. Since 
most images will only have a small fraction of color val- 
ues that are out of gamut, the residual images 27 will be 
dominated by zeros, and therefore will be highly com- 



pressible. 

[0029] For cases where the operation of determining 
the limited color gamut digital images 26 involves the 
application of a transform that modifies the color values 

5 for the colors within the limited color gamut as well as 
those outside the limited color gamut, residual images 
27 determined by directly computing the difference 
between the input color values of the extended color 
gamut digital images 21 and the adjusted color values 

10 of the limited color gamut digital images 26 would have 
a large number of non-zero values. This can be undesir- 
able for cases where the residual images 27 are to be 
compressed. The prior example where the extended 
color gamut digital images 21 are representations of 

15 original scenes, and the determination of the limited 
color gamut digital images 26 includes rendering the 
color values to determine desirable color values for a 
target display device, will generally suffer from this prob- 
lem. In this case, it can be desirable to apply a second 

20 rendering function to the extended color gamut digital 
images 21 to determine a second set of rendered color 
values that are desirable for another display device hav- 
ing a larger color gamut than the first target display 
device. If the second rendering function were identical 

25 to the first rendering function throughout most of the 
color gamut, then residual images 27 computed by tak- 
ing the difference between the first and second ren- 
dered images would again be largely dominated by zero 
differences. In one embodiment of the present inven- 

30 tion, the first rendering function performed by the image 
processing unit 22 produces rendered images opti- 
mized for a video display, and the second rendering 
function performed by the image processing unit 22 pro- 
duces rendered images optimized for some hypothetical 

35 display device having an idealized large color gamut. 
[0030] In another embodiment the image processing 
unit 22 computes the residual images 27 relative to the 
storage color space color values. Therefore, the original 
extended color space digital images 21 must be trans- 
it? formed to the storage color space in addition to the lim- 
ited color gamut digital images 26. The complication is 
that the storage color space will typically only have a 
limited color gamut. For example, if the storage color 
space is a video RGB color space, then the color gamut 

45 of the storage space would be limited to the color gamut 
of the video display. Therefore, to represent the original 
extended color gamut digital images 21 in the storage 
color space, it is necessary to define an extended ver- 
sion of the storage color space that does not impose the 

so limited color gamut. For example, 24-bit video RGB 
color spaces usually encode the color values in terms of 
integer code values in the range of 0 to 255. In order to 
allow the encoding of colors outside the color gamut of 
the video display, the original extended color gamut dig- 

55 ital images 21 can be represented in an extended stor- 
age space where the code values were allowed to go 
outside the range 0 to 255. This permits the encoding of 
colors with higher chroma values, as well as larger lumi- 
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nance dynamic range values, than could be encoded 
directly in the storage color space. After both the limited 
color gamut digital images 26 and the extended color 
gamut digital images 21 have been represented in 
terms of the storage color space, the residual images 27 5 
are then calculated as before by computing a difference 
between each corresponding two images. This embodi- 
ment results in residual image(s) 27, each representing 
a difference between an extended color gamut digital 
image 21 represented in an extended storage color 10 
space and its corresponding limited color gamut digital 
image 26 represented in the corresponding limited color 
gamut storage color space. 

[0031] In a third embodiment of the present invention, 
the image processing unit 22 compresses each limited 15 
color gamut digital image 26 to form a compressed lim- 
ited color gamut digital image. The compression opera- 
tion may be performed using any one of many image 
data compression methods such as the well-known 
JPEG compression method, which is based on a dis- 20 
crete cosine transform. There are many other types of 
image data compression methods known to those 
skilled in the art including those based on differential 
pulse code modulation, vector quantization, wavelets, 
or fractals. In some cases, the image data compression 25 
algorithms are lossless, meaning that an exact copy of 
the original image can be reconstructed from the com- 
pressed image. However, in many cases, the image 
data compression algorithms are lossy meaning that an 
image reconstructed from the compressed image will 30 
only be an approximation of the original image. In these 
cases, the use of image data compression will introduce 
errors into the limited color gamut digital images 26. 
[0032] The operation of computing the residual 
images 27 in this embodiment of the present invention 35 
is slightly modified relative to the previous embodi- 
ments. Rather than computing the residual image(s) 27 
based on an original limited color gamut digital image 
26, the residual image(s) 27 are computed from an 
uncompressed version of a compressed limited color 40 
gamut digital image. In this way, the residual image(s) 
27 not only include the differences introduced by repre- 
senting the image in the limited color gamut, but also 
account for losses introduced in the image data com- 
pression process. In particular the image processing 45 
unit 22 computes the residual image(s) 27 to represent 
the difference between an extended color gamut digital 
image 21 represented in an extended storage color 
space and an uncompressed version of its correspond- 
ing compressed limited color gamut digital image 26. so 
[0033] There are several reasons why it can be advan- 
tageous to store multiple residual images instead of just 
a single residual image. For example, it might be desir- 
able to store residual errors associated with luminance 
errors in one residual image, and residual errors associ- 55 
ated with chrominance errors in additional residual 
images. This can enable an application to make a 
choice about which types of residual errors it would use 



during the ^process of determining a reconstructed 
extended color gamut digital image. 
[0034] In another case, multiple residual images can 
correspond to different subsets of extended dynamic 
range image data. For example, a first residual image 
can extend the dynamic range of the digital image some 
fixed amount beyond the dynamic range associated 
with the limited color gamut digital image. A second 
residual image can then extend the dynamic range an 
additional increment beyond the extended dynamic 
range associated with the first residual image. In this 
way, an application using the extended color gamut dig- 
ital images can use only the residual images associated 
with the amount of extended dynamic range required by 
the application. 

[0035] Another reason that using multiple residual 
images is useful is for cases where the residual images 
are stored in tags in digital image files having a limited 
size. In this case, the residual image data can be broken 
into smaller pieces that would fit within the size limita- 
tions. For example, residual images can be determined 
for subsets of pixels in the extended color gamut digital 
image. In this way, the residual image data can be 
stored in a tiled fashion. 

[0036] Once the residual images 27 are calculated, 
each should be associated in some fashion with its lim- 
ited color gamut digital image 26 represented in the 
storage color space. This can involve storing the resid- 
ual image(s) 27 in a memory buffer that is associated 
with a second memory buffer used to store the limited 
color gamut digital image 26 represented in the storage 
color space. Alternatively, the image processing unit 22 
can store the limited color gamut digital images and 
their associated residual images 27 in one or more dig- 
ital image files 23 on some sort of transportable digital 
storage media 25 such as a magnetic disk, an optical 
disk, or a PCMCIA card by means of the digital file out- 
put unit 24. In this case, each limited color gamut digital 
image 26 and its associated residual image(s) 27 could 
be stored in two different associated files, or could be 
stored in the same digital image file 23. In many cases, 
the file format used to store the digital image files 23 
may support the use of private image tags. For exam- 
ple, the file formats TIFF, EXIF and FlashPIX all support 
tags of this sort. These tags are sometimes referred to 
as meta-data. In cases where file formats of this type 
are used, it will be convenient to store the residual 
image data in the form of a residual image tag. In this 
way, applications that do not know how to make use of 
the residual image tag will simply ignore it, and will 
therefore have access only to the limited color gamut 
digital images 26 represented in the storage color 
space. Whereas applications that know how to use the 
residual image tag will be able to make use of it to 
reconstruct the originating extended color gamut digital 
images 21 used to create the limited color gamut digital 
images 26 and their associated residual images 27. 
Some file formats place a limit on the size of tags, so the 
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image processing unit 22 will compress the residual 
images 27 for use with these file formats. Compressing 
the residual images 27 can be accomplished using 
many different types of image data compression meth- 
ods. In some cases, it will be desirable to compress the 
residua! image using a lossless image data compres- 
sion method, whereas in other cases, it will be accepta- 
ble to use a so-called lossy image data compression 
method. 

[0037] Another embodiment of the present invention 
is shown in FIG. 3. This embodiment is similar to that 
shown in FIG. 2 but differs in the way that the image 
processing unit 32 operates on the extended color 
gamut digital images 21 . An image processing unit 32 in 
this embodiment performs a produce modified extended 
images task 33 to produce (1-n) modified extended 
color gamut digital images 34 and then performs a pro- 
duce images task 35 to produce (1-n) limited color 
gamut digital images 36 with (1-n) associated residual 
images 37. As discussed with reference to the imaging 
system shown in FIG. 2, this imaging system has opto- 
electronic image digitization device(s) 20 that digitize 
still photographic images and produce extended color 
gamut digital images 21. The image processing unit 32 
receives the extended color gamut digital images 21 
from the opto-electronic image digitization device(s) 20. 
The image processing unit 32 operates on, each 
extended color gamut digital image 21 as it is available 
to produce at least one corresponding modified 
extended color gamut digital image 34. Then the image 
processing unit 32 operates on each modified extended 
color gamut digital image 34 as it is available to produce 
a corresponding limited color gamut digital image 36 by 
adjusting the color values of each modified extended 
color gamut digital image 34 to fit within a limited color 
gamut. Next, as each, limited color gamut digital image 
36 is available, the image processing unit 32 represents 
each limited color gamut image 36 in a storage color 
space. Then the image processing unit 32 determines 
one or more residual image(s) 37, associated with each 
limited color gamut digital image 36, and representing 
the difference between each limited color gamut digital 
image 36 and its corresponding modified extended 
color gamut digital image 34. The limited color gamut 
digital images 36 in the storage color space and their 
associated residual images 37 are associated such that 
they are adapted to be used to reconstruct modified 
extended color gamut digital images 34. Further, the 
image processing unit 32 is shown coupled to a soft- 
copy display device 30 and a user command input 
device 31, provided as a means of interacting with a 
person operating the imaging system. 
[0038] Since most of the operations in this embodi- 
ment of the invention are identical to the corresponding 
operations in the previous embodiments, only the oper- 
ations that differ will be discussed in more detail. The 
primary distinction with this embodiment is that the 
extended color gamut digital images 21 received by the 



image processing unit 32 from the opto-electrical digiti- 
zation device(s) 20 are not used directly to create the 
limited color gamut digital images 36. Instead, the 
image processing unit 32 adjusts the extended color 
5 gamut digital images 21 to form modified extended color 
gamut digital images 34, representing preferred images 
for further use in the imaging system. 
[0039] In some cases, the modifications to the 
extended color gamut digital images 21 can be deter- 
to mined by applying an automatic algorithm. One exam- 
ple of this type of modification is an exposure correction 
operation. An exposure correction operation can be 
used, first, to determine an image modification neces- 
sary to correct an image for over exposure, under expa- 
ts sure, or extremes in original exposure illumination, and 
second, to apply the determined modification, produc- 
ing a modified extended color gamut digital image 34. 
[0040] Alternatively, the modifications to the extended 
color gamut digital images 21 can be interactively deter- 
20 mined by a person operating the imaging system. For 
example, the image processing unit 32 can display, 
through the softcopy display device 30, an appropriate 
representation of each extended color gamut digital 
image 21. Then, through the user command input 
25 device 31 , the image processing unit 32 can enable the 
person operating the imaging system to specify a partic- 
ular region of interest to be used in cropping in each 
original extended color gamut digital image 21 to obtain 
each corresponding modified extended color gamut dig- 
30 ital image 34. 

[0041] As was the case with the extended color gamut 
digital images 21 in the previous embodiments, the 
modified extended color gamut digital images 34 result- 
ing from scans of photographic negatives, or resulting 
35 from images produced in digital cameras can contain 
information representative of the colors of original 
scenes having a much larger luminance dynamic range 
than can be encoded in many storage color spaces. On 
the other hand, modified extended color gamut digital 
40 images 34 from photographic negatives, photographic 
transparencies, or from photographic prints may repre- 
sent in turn the colors of each of these image source 
photographic media. In some cases it can be preferable 
to represent the modified extended color gamut digital 
45 images 34 from a variety of image sources as adjusted 
color values suitable for an extended color gamut dis- 
play device, such as a hypothetical display device hav- 
ing an idealized color gamut. This approach can provide 
a common representation from a variety of image 
so sources, within certain systems. 

[0042] Once the modified extended color gamut digital 
images 34 have been determined, the determination of 
the limited color gamut digital image 36 corresponding 
to each modified extended color gamut digital image 34, 
55 and then the computation of one or more residual 
image(s) 37 associated with each of those limited color 
gamut digital images 36 is performed by the image 
processing unit 32 in the same fashion described in the 
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previous embodiments, with the exception that the mod- 
ified extended color gamut digital images 34 are used in 
place of the extended color gamut digital images 21 . As 
in the previous embodiments, once the residual 
image(s) 37 have been calculated, each is associated in 5 
some fashion with its limited color gamut digital image 
36 represented in the storage color space such that 
they are adapted to be used to reconstruct modified 
extended color gamut digital images 34. 
[0043] The result of applying the imaging systems of 10 
the present invention shown in FIG. 2 and FIG. 3 is the 
creation of both limited color gamut digital images in a 
storage color space and associated residual images 
which correlate the limited color gamut digital images to 
extended color gamut digital images. As discussed pre- 15 
viously, the limited color gamut digital images are gener- 
ally well suited for display on a target display device 
such as a video display. One advantage of this 
approach is that systems that cannot make use of the 
residual images will be able to display and manipulate 20 
the limited color gamut digital images directly with no 
image quality or computation disadvantage relative to 
the prior art where only the limited color gamut digital 
image is stored. However, the information that normally 
would have been discarded has now been stored in the 25 
residual images and is available for use by imaging sys- 
tems that can utilize it. In these systems, the limited 
color gamut digital images are extracted with the resid- 
ual images from the digital image files, and can be used 
to reconstruct the originating extended color gamut dig- 30 
ital images. As discussed previously, in some cases the 
limited color gamut digital images and their associated 
residual images can be used to construct other related 
extended color gamut images as well. The reconstruc- 
tion and use of the extended color gamut digital images 35 
will be the same whether the limited color gamut digital 
images and associated residual images were formed 
originally from extended color gamut digital images or 
were formed originally from modified extended color 
gamut digital images. 40 
[0044] FIG. 4 shows an embodiment of an imaging 
system that uses limited color gamut digital image(s) 
with their associated residual image(s) to form digital 
image(s) appropriate for display on a particular display 
device. The input to this system is one or more digital 45 
image file(s) 23, stored on a transportable digital stor- 
age medium 25, and containing limited color gamut dig- 
ital image(s) 45 in a storage color space with their 
associated residual image{s) 46 created as described 
above. A digital lile input unit 40 reads the digital image so 
file{s) 23 and delivers them to an image processing unit 
43. The image processing unit 43 performs a form dis- 
play images task 49 by accepting each of the digital 
image file(s) 23 and then processing the limited color 
gamut digital image(s) 45 and their associated residual 55 
image(s) 46 to derive (1-n) digital image{s) appropriate 
for display on a particular display device, such as the 
hardcopy display device 48 shown. The hardcopy dis- 



play device 48 accepts each display-processed digital 
image from the image processing unit 43 and produces 
corresponding hardcopy photographic prints. The hard- 
copy display device can be one of a variety of printing 
devices such as a laser writer, a thermal dye-diffusion 
printer, or an inkjet printer. 

[0045] In addition to the creation of hardcopy prints, 
such an imaging processing unit 43 can function to 
transmit either the input digital image file(s) 23, or digital 
image file(s) created from the display-processed digital 
image(s) in accordance with this invention, electroni- 
cally through a digital communications connection 47 
such as an internet connection or a local area network. 
The image processing unit 43 can deliver the transmit- 
ted digital image file(s) 42 over the digital communica- 
tions connection 47 for use at a particular remote digital 
imaging site, or can make the transmitted digital image 
file(s) 42 available for general access over a connection 
such as the world-wide web. 

[0046] The image processing unit 43 can also use the 
limited color gamut digital image(s) 45 with their associ- 
ated residual image(s) 46 in performing a reconstruct 
extended images task 41 to form (1-n) reconstructed 
extended color gamut image(s) 44. Typically forming the 
reconstructed extended color gamut digital image(s) 44 
will involve combining the limited color gamut digital 
image(s) 45 and their associated residual image{s) 46. 
[0047] The reconstructed extended color gamut digital 
image(s) 44 can be used to form the digital image(s) 
appropriate for display on the hardcopy display device 
48. Use of the reconstructed extended color gamut dig- 
ital images 44 to form the digital images for display on 
the hardcopy display device 48 is particularly appropri- 
ate in the situation where the hardcopy display device 
48 has a color gamut different from the limited color 
gamut of the limited color gamut digital images 45 in the 
digital image files 23. This enables the generation of 
optimal prints from the extended color gamut digital 
images, rather than prints limited by constraints of the 
storage color space. For example, in the case where the 
reconstructed extended color gamut digital images 44 
are representative of the colors of original scenes, 
adjusting the color values to form the digital images 
appropriate for display on the hardcopy display device 
48 can involve rendering the reconstructed extended 
color gamut digital images 44 to determine the desired 
aim reproduced colors for the target hardcopy display 
device 48. On the other hand, a different color adjust- 
ment function can be required to create the display- 
processed images for the hardcopy'display device 48 in 
the situation where the reconstructed extended color 
gamut digital images 44 are representative of the colors 
of a photographic medium. This might be the case if the 
original image sources were scanned photographic 
negatives, photographic transparencies, or photo- 
graphic prints. In some cases, reconstructed extended 
color gamut digital images 44 from a variety of image 
sources can have a common representation as 
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adjusted color values suitable for an extended color 
gamut display device, such as a hypothetical display 
device having an idealized color gamut. In this situation 
the image processing unit 43 can apply a common color 
adjustment function to each of these reconstructed 
extended color gamut digital image(s) 44 to constrain 
the color gamut of the extended color gamut display 
device to the real color gamut of the target hardcopy dis- 
play device 48. 

[0048] FIG. 5 shows a preferred embodiment of an 
imaging system that uses limited color gamut digital 
image(s) 45 with associated residual image(s) 46. The 
input to this system is one or more digital image file(s) 
23, stored on a transportable digital storage medium 25, 
or received from a digital communications connection 
47. Said digital image files 23 containing limited color 
gamut digital image(s) 45 in a storage color space with 
their associated residual image(s) 46 created as 
described above. As shown in FIG. 5, a digital file input 
unit 40 reads digital image file(s) 23 and delivers them 
to an image processing unit 50. The image processing 
unit 50 performs a determine modified extended images 
task 51 by accepting each of the digital image file(s) 23 
and then processing the (1-n) limited color gamut digital 
image(s) 45 and their (1-n) associated residual 
image(s) 46 to determine and apply desired modifica- 
tion^), thereby determining (1-n) modified recon- 
structed extended color gamut digital image(s) 52. The 
image processing unit 50 is shown coupled to a soft- 
copy display device 30 and a user command input 
device 31, so that image modifications can be deter- 
mined through interaction with the person operating the 
imaging system. 

[0049] In the process of determining the desired mod- 
ification^) from the input limited color gamut digital 
images 45 and their associated residual image(s) 46 the 
images processing unit 50 can perform a reconstruct 
extended images task 41 by forming (1-n) reconstructed 
extended color gamut digital image(s) 44. For a given 
type of modification, the use of the reconstructed 
extended color gamut digital image(s) 44 can be pre- 
ferred in determining the modification. For example, 
consider the case where an input limited color gamut 
digital image 45 is determined to be over-exposed. In 
this case, the highlights of the limited color gamut digital 
image 45 would have been clipped when it was derived 
from its originating extended color gamut digital image. 
However, that highlight information, retained in the 
associated residual image(s) 46, can be restored in the 
reconstructed extended color gamut digital image 44. 
This highlight information can then be used to deter- 
mine an exposure-corrected (that is, modified) recon- 
structed extended color gamut digital image 52, and 
thereby a modified limited color gamut digital image 53 
that retains the highlight detail. Modification(s) to the 
digital image(s) can be interactively specified by a per- 
son operating the digital imaging system, such as in the 
case of an adjustable lightness knob provided with pre- 



view limited color gamut digital image(s) on the softcopy 
display device 30. In the case where the storage color 
space is a video RGB color space the input limited color 
gamut digital image(s) 45 would be suitable for preview 

5 display as they are received. The person operating the 
imaging system might then provide the desired level of 
correction through the user command input device 31. 
Modification (s) can also be determined by applying an 
automatic algorithm to the digital image. For example, a 

10 "scene balance algorithm" can be used to estimate the 
best color balance and exposure correction level for an 
image. 

[0050] The image processing unit 50 can also use the 
resulting modified reconstructed extended color gamut 

is digital image(s) 52 to perform a form modified display 
images task 57 by forming (1-n) image(s) appropriate 
for display on a particular hardcopy display device 48. 
As discussed previously, use of the modified recon- 
structed extended color gamut digital image(s) 52, 

20 rather than limited color gamut digital image (s), to form 
the digital image(s) for display on the hardcopy display 
device 48 is particularly appropriate in the situation 
where the hardcopy display device 48 has a color gamut 
different from the limited color gamut of the input limited 

25 color gamut digital image(s) 23. This enables the gener- 
ation of optimal prints from the modified extended color 
gamut digital image(s), rather than prints limited by con- 
straints of the storage color space. The hardcopy dis- 
play device 48 accepts each display -processed image 

30 from the image processing unit 50 and produces corre- 
sponding hardcopy photographic prints. 
[0051] In some cases, it will be desirable to send the 
modified digital image(s) directly to a display device, but 
in other cases it can be desirable to write the modified 

35 digital image(s) back out to modified digital image file(s) 
55. When required, the image processing unit 50 can 
perform a produce modified images task 56 to deter- 
mine (1-n) modified limited color gamut digital image(s) 
53 and (1-n) associated modified residual image(s) 54, 

AO thereby encoding the modified reconstructed extended 
color gamut digital image(s) 52, using the methods 
described by this invention. Further, the image process- 
ing unit 50 can then operate on each modified limited 
color gamut digital image 53 with its associated modi- 

45 fied residual image (s) 54 to create corresponding modi- 
fied digital image file(s) 55, stored internally using a 
digital storage medium. Each modilied digital image file 
55 can then be delivered to a digital file output unit 24 
which stores each digital image file 55 on a transporta- 

so ble digital storage medium 25. 

[0052] The imaging processing unit 50 can also func- 
tion to transmit either the original digital image file(s) 23, 
the modified digital image file(s) 55, or the display-proc- 
essed digital image file(s), electronically through a dig- 

55 ital communications connection 47 such as an internet 
connection or a local area network. The image process- 
ing unit can deliver the transmitted digital image file(s) 
over the digital communications connection 47 for use 
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at a particular remote digital imaging site, or can make 
the transmitted digital image file(s) available for general 
access over a connection such as the world-wide web. 
[0053] Other features of the invention are included 
be low. 5 
[0054] The system where at least one of the opto- 
electronic image digitization devices produces extended 
color gamut digital images from scans of photographic 
negatives. 

[0055] The system where at least one of the opto- 
electronic image digitization devices produces extended 
color gamut digital images from scans of photographic 
transparencies. 

[0056] The system where at least one of the opto- 
electronic image digitization devices produces extended 
color gamut digital images from scans of photographic 
prints. 

[0057] The system where at least one of the opto- 
electronic image digitization devices is a digital camera 
producing extended color gamut digital images from 
original scenes. 

[0058] The system where the extended color gamut 
digital images are representative of the colors of original 
scenes. 

[0059] The system where the extended color gamut 
digital images are representative of the colors of a pho- 
tographic medium. 

[0060] The system where the extended color gamut 
digital images are represented as adjusted color values 
that are desirable for an extended color gamut display 
device. 

[0061] The system where the extended color gamut 
display device is a hypothetical display device having an 
idealized color gamut. 

[0062] The system where the limited color gamut dig- 
ital images are determined by clipping colors that are 
outside the limited color gamut so that they are on the 
surface of the limited color gamut. 
[0063] The system where the limited color gamut dig- 
ital images are determined by using gamut mapping 
that preserves color appearance. 
[0064] The system where the limited color gamut dig- 
ital images are determined by modifying color values 
that are outside the limited color gamut so that they are 
mapped to color values within the limited color gamut. 
[0065] The system where the extended color gamut 
digital images have a larger range of chroma values 
than the limited color gamut digital images. 
[0066] The system where the extended color gamut 
digital images have a larger luminance dynamic range 
than the limited color gamut digital images. 
[0067] The system wherein the means for adjusting 
the color values of each extended color gamut digital 
image to determine a corresponding limited color gamut 
digital image includes applying a tone scale function to 
reduce the luminance dynamic range of the image. 
[0068] The system where the extended luminance 
dynamic range digital images are monochrome digital 



images. 

[0069] The system including a particular display 
device and wherein each limited color gamut digital 
image is determined by adjusting the colors of an 
extended color gamut digital image to produce adjusted 
color values that are desirable for the particular display 
device. 

[0070] The system wherein said image processing 
unit is operative to compress the limited color gamut 
digital images in the storage color space using an image 
data compression technique. 

[0071] The system where the storage color space is a 
particular device dependent color space. 
[0072] The system where the storage color space is a 
video RGB color space. 

[0073] The system wherein the storage color space is 
a particular limited color gamut color space. 
[0074] The system further including a digital file output 
unit, coupled to said image processing unit, which is 
operative to store the digital image files on a transporta- 
ble digital storage medium. 

[0075] The system where the residual images are 
stored as meta-data in the digital image files. 
[0076] The system where an image data compression 
technique is applied to the residual images before they 
are stored so that they each use a smaller amount of 
digital storage memory. 

[0077] The system where the limited color gamut dig- 
ital images are stored in the digital image files, and the 
associated residual images are stored in separate asso- 
ciated digital image files. 

[0078] The system further including a softcopy display 
device and user command input device, coupled to said 
image processing unit, for providing interactively user 
specified modification (s) to the extended color gamut 
digital image{s). 

[0079] The system wherein the modification(s) to the 
extended color gamut digital image(s) are determined 
by applying an automatic algorithm. 
[0080] The system wherein the residual image(s) 
together with the limited color gamut digital image(s) in 
the storage^ color space are used to reconstruct 
extended color gamut digital image(s). 
[0081] The system wherein the reconstructed 
extended color gamut digital image(s) are used to form 
the digital image(s) appropriate for display on the partic- 
ular display device. 

[0082] The system wherein the particular display 
device has a color gamut different than the limited color 
gamut. 

[0083] The system wherein said image processing 
unit is operative to digitally transmit at least one said 
digital image file through digital communications. 
[0084] The system further including at least one hard- 
copy display device operative to accept a plurality of dig- 
ital images and to produce corresponding hardcopy 
photographic prints. 

[0085] The system wherein the residual image(s) 
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[0086] The system wherein the desirable modifica- 
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46 


residual image(s) 


tion^) to the limited color gamut digital image(s) and 




47 


digital communications connection 


associated residual image{s) are determined by apply- 




48 


hardcopy display device 


ing an automatic algorithm. 


10 


49 


form display images task 


[0088] The system wherein said image processing 
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modified digital image files 


ital image file(s), using the digital storage medium, con- 




56 


produce modified images task 


taining modified limited color gamut digital image(s) in 




57 


form modified display images task 


the storage color space with their associated modified 
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residual image(s). 




Claims 


[0090] The system further including a digital file output 








unit, coupled to said image processing unit, which is 




1. 


A digital image processing system comprising: 


operative to store said modified digital image file(s) on a 








transportable digital storage medium. 


25 




a) one or more opto-electronic image digitiza- 


[0091] The system wherein said image processing 






tion device(s) which digitize still photographic 


unit also being operative to digitally transmit at least one 






images and produce an extended color gamut 


said modified digital image file through digital communi- 






digital image corresponding to each still photo- 


cations. 






graphic image; and 


[0092] The system further including at least one hard- 


30 




b) an image processing unit, coupled with said 


copy display device operative to accept a plurality of dig- 






image digitization device(s), which is operative 


ital images and to produce corresponding hardcopy 






to receive a plurality of extended color gamut 


photographic prints. 






digital images from said image digitization 
device(s) and including means for; 
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i) producing at least one limited color 


[0093] 






gamut digital image from each said 
extended color gamut digital image by 


1 0 video RGB color gamut 






adjusting the color values of the extended 


1 2 reflection print color gamut 
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color gamut digital image to fit within a lim- 


20 image digitization devices 






ited color gamut; 


21 extended color gamut digital images 






ii) representing each said limited color 


22 image processing unit 






gamut digital image in a storage color 


23 digital image files 






space; 


24 digital file output unit 
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iii) determining one or more residual 


25 transportable digital storage medium 






image(s) each representing a difference 


26 limited color gamut digital images 






between one said extended color gamut 


27 residual images 






digital image and its corresponding limited 


28 produce images task 






color gamut digital image; and 


30 softcopy display device 


50 




iv) associating each limited color gamut 


31 user command input device 






digital image in the storage color space 


32 image processing unit 






with its residual image(s) such that the 


33 produce modified extended images task 






associated residual images and the limited 


34 modified extended color gamut digital images 






color gamut digital images in the storage 


35 produce images task 
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color space are adapted to be used to 


36 limited color gamut digital images 






reconstruct extended color gamut digital 


37 residual images 






images. 


40 digital file input unit 
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The system according to claim 1 where each resid- 
ua! image is determined by computing a difference 
between each extended color gamut digital image 
represented in an extended storage color space 
and its corresponding limited color gamut digital 
image represented in the storage color space. 

The system according to claim 19 where each 
residual image is determined by computing a differ- 
ence between each extended color gamut digital 
image represented in an extended storage color 
space and an uncompressed version of its corre- 
sponding compressed limited color gamut digital 
image. 

The system according to claim 1 wherein the sys- 
tem uses a digital storage medium and said image 
processing unit includes means for producing dig- 
ital image files, using the digital storage medium, 
containing limited color gamut digital images in the 
storage color space with their associated residual 
images. 

The digital image processing system comprising: 

a) one or more opto-electronic image digitiza- 
tion device(s) which digitize still photographic 
images and produce an extended color gamut 
digital image corresponding to each still photo- 
graphic image; and 

b) an image processing unit, coupled with said 
image digitization device(s), which is operative 
to receive a plurality of extended color gamut 
digital images from said image digitization 
device(s) and including means for: 

i) producing at least one modified 
extended color gamut digital image from 
said extended color gamut digital images; 

ii) producing at least one limited color 
gamut digital image from each said modi- 
fied extended color gamut digital image by 
adjusting the color values of the modified 
extended color gamut digital image to fit 
within a limited color gamut; 

iii) representing each said limited color 
gamut digital image in a storage color 
space; 

iv) determining one or more residual 
image(s) each representing a difference 
between one said modified extended color 
gamut digital image and its corresponding 
limited color gamut digital image; and 

v) associating each limited color gamut 
digital image in the storage color space 
with its residual image(s) such that the 
associated residual images and the limited 
color gamut digital images in the storage 
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color space are adapted to be used to 
reconstruct extended color gamut digital 
images. 

6. A digital image processing system for receiving 
information from a transportable digital storage 
medium and for producing an image for a particular 
display device, comprising: 

a) a digital file input unit, coupled to read the 
contents of the transportable digital storage 
medium containing one or more digital image 
file(s) that have been stored thereon, said dig- 
ital image file(s) containing limited color gamut 
digital image (s) in a storage color space with 
associated residual image(s) such that the 
associated residual image(s) and the limited 
color gamut digital image(s) are adapted to be 
used to reconstruct extended color gamut dig- 
ital images; and 

b) an image processing unit, coupled to said 
digital file input unit, said image processing unit 
for accepting one or more of said digital image 
file(s) from said digital file input unit, and using 
the digital image(s) contained in said digital 
image file(s) to form digital image{s) appropri- 
ate for display on the particular display device. 

7. A digital image processing system comprising: 

a) one or more digital file source(s), being indi- 
vidually or any combination of a digital file input 
unit, coupled to read the contents of a trans- 
portable digital storage medium containing one 
or more digital image file(s) that have been 
stored thereon, or a digital communications 
connection operative to receive one or more 
digital file(s), said digital image fiie(s) contain- 
ing limited color gamut digital image(s) in a 
storage color space with associated residual 
image(s) such that the associated residual 
image(s) and the limited color gamut digital 
image(s) are adapted to be used to reconstruct 
extended color gamut digital image(s); and 

b) an image processing unit, coupled to said 
digital file input unit, said image processing unit 
being operative to accept one or more of said 
digital image file(s) from said digital file input 
unit, and including means for: 

i) specifying at least one desirable modifi- 
cation to one or more of the limited color 
gamut digital image(s) and associated 
residual image{s) contained in said digital 
image 1ile(s); and 

ii) using each residual image together with 
its limited color gamut digital image in the 
storage color space, and its specified 
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desirable modification (s), to determine 
each corresponding modified extended 
color gamut digital image. 

8. The system according to claim 38, further including 
a softcopy display device, coupled with said image 
processing unit, and is operative to display a pre- 
view of digital image(s) by displaying the limited 
color gamut digital image(s) in the storage color 
space. 

9. The system according to claim 41, further including 
a user command input device, coupled to said 
image processing unit and said softcopy display 
device, for providing interactively user specified is 
desirable modification(s) to the limited color gamut 
digital image(s) and their associated residual 
image(s). 

10. The system according to claim 38, wherein said 20 
image processing unit further includes means for: 

i) producing at least one modified limited color 
gamut digital image from each said modified 
extended color gamut digital image by adjust- 25 
ing the color values of the modified extended 
color gamut digital image to fit within a limited 
color gamut; 

ii) representing each said modified limited color 
gamut digital image in a storage color space; 30 

iii) determining one or more modified residual 
image(s) each representing a difference 
between one said modified extended color 
gamut digital image and its corresponding 
modified limited color gamut digital image; and 35 

iv) associating each modified limited color 
gamut digital image in the storage color space 
with its modified residual image(s) such that 
the associated modified residual image(s) and 
the modified limited color gamut digital 40 
image(s) in the storage color space are 
adapted to be used to reconstruct extended 
color gamut digital image(s). 
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